Detecting Item Memorization in the CAT Environment
نویسندگان
چکیده
منابع مشابه
Using Automatic Item Generation to Address Item Demands for CAT
Item writing is a craft that is both resource intensive and time consuming. In order to minimize item exposure, computer adaptive testing requires a large number of test items for administration. As test development become more complex, demand for the quantity and quality of items far exceeds the capacity of item writers writing in the current fashion. To address the demand for items to be crea...
متن کاملOnline Item Calibration for Q-matrix in CD-CAT
Item replenishment is important to maintaining a large scale item bank. In this paper we consider calibrating new items based on pre-calibrated operational items under the DINA model, the specification of which includes the so-called Q-matrix, as well as the slipping and guessing parameters. Making use of the maximum likelihood and Bayesian estimators for the latent knowledge states, we propose...
متن کاملDetecting measurement disturbance effects: the graphical display of item characteristics.
Traditional identification of misfitting items in Rasch measurement models have interpreted the Infit and Outfit z standardized statistic. A more recent approach made possible by Winsteps is to specify "group = 0" in the control file and subsequently view the item characteristic curve for each item against the true probability curve. The graphical display reveals whether an item follows the tru...
متن کاملDetecting Learning vs Memorization in Deep Neural Networks using Shared Structure Validation Sets
Abstract: The roles played by learning and memorization represent an important topic in deep learning research. Recent work on this subject has shown that the optimization behavior of DNNs trained on shuffled labels is qualitatively different from DNNs trained with real labels. Here, we propose a novel permutation approach that can differentiate memorization from learning in deep neural network...
متن کاملDetecting differential item functioning in behavioral indicators across parallel forms.
BACKGROUND Despite the crucial importance of the notion of parallel forms within Classical Test Theory, the degree of parallelism between two forms of a test cannot be directly verified due to the unobservable nature of true scores. We intend to overcome some of the limitations of traditional approaches to analyzing parallelism by using the Differential Item Functioning framework. METHOD We c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Psychological Measurement
سال: 1999
ISSN: 0146-6216,1552-3497
DOI: 10.1177/01466219922031275